Two-limit Problems for Almost Semicontinuous Processes Defined on a Markov Chain
نویسنده
چکیده
Problems related to the exit of a process with independent increments from an interval were investigated in many works (see, e.g. [1], [2]). Analogous problems were investigated for processes on a finite Markov chain under the semicontinuity condition [3, 4]. For walks on a countable Markov chain, a two-dimensional problem was studied in [5]. In the present paper, we consider distributions of some functionals associated with the exit from a bounded interval for a process with independent increments on a finite Markov chain under the assumption that this process crosses a positive level only by exponentially distributed jumps (an almost semicontinuous process [6]). The distributions of overjump functionals described by integral equations on a semi-axes are defined by the projection factorization method using an infinitely divisible factorization (instead of canonical factorization). In the present paper, we investigate functionals described by integral equations on an interval that can be extended to a semi-axes. In the solution of the extended equation, we use the method developed by Krein in [7, 8] and probability factorization identities. Consider a two-dimensional Markov process:
منابع مشابه
Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملOvershoot Functionals for Almost Semi-continuous Processes Defined on a Markov Chain
The distribution of extrema and overjump functionals for the semi-continuous processes (processes that intersect positive or negative level continuously) on a Markov chain were considered by many authors( for instance, see [1] [3]). In the paper [4] the distribution of extrema for almost semi-continuous processes were treated (the processes that intersect positive or negative level by exponenti...
متن کاملAlgorithms for Computing Limit distributions of Oscillating Systems with Finite Capacity
We address the batch arrival systems with finite capacity under partial batch acceptance strategy where service times or rates oscillate between two forms according to the evolution of the number of customers in the system. Applying the theory of Markov regenerative processes and resorting to Markov chain embedding, we present a new algorithm for computing limit distributions of the number cus...
متن کاملAbsorbing Markov Chain Models to Determine Optimum Process Target Levels in Production Systems with Rework and Scrapping
In this paper, absorbing Markov chain models are developed to determine the optimum process mean levels for both a single-stage and a serial two-stage production system in which items are inspected for conformity with their specification limits. When the value of the quality characteristic of an item falls below a lower limit, the item is scrapped. If it falls above an upper limit, the item is ...
متن کاملADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes
In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009